Multilingual Information Retrieval Using Recall Metric Variants
نویسنده
چکیده
The performance evaluation of information retrieval systems has achieved a high momentum in the last few years. Basic performance measures of information retrieval systems include precision and recall. While these measures work well in monolingual web retrieval, they are not suitable for CLIR (Cross-lingual Information Retrieval) and MLIR (Multilingual Information Retrieval) where two or more languages are involved respectively. Many measures were proposed to improve over the precision and recall measures but they are inadequate to exhibit the language wise performance evaluations. Recall metric variants for evaluating the performance over the retrieval of the documents in various languages have been proposed in this research. This paper also identifies the major strengths and shortcomings of some of the existing IR performance evaluation measures. This paper concentrates on the metric based performance evaluation on two variants of IR. Experiments are conducted in two phases (CLIR and MLIR). These two phases of experiments have been done on practical web search systems and proved that the proposed measures are necessary to reveal the importance of language wise comparisons.
منابع مشابه
Performance Evaluation of CLIR and MLIR using Precision Metric Variants
The performance evaluation of information retrieval systems has achieved a high momentum in the last few years. Basic performance measures of information retrieval systems include precision and recall. While these measures work well in monolingual web retrieval, they are not suitable for CLIR (Cross-lingual Information Retrieval) and MLIR (Multilingual Information Retrieval) where two or more l...
متن کاملCross Language Information Retrieval Using Multilingual Ontology as Translation Base
This paper reports an experiment to evaluate a Cross Language Information Retrieval (CLIR) system that uses a multilingual ontology to improve query translation in the travel domain. The ontology-based approach significantly outperformed the Machine Readable Dictionary translation baseline using Mean Average Precision as a metric in a user-centered experiment.
متن کاملReview of ranked-based and unranked-based metrics for determining the effectiveness of search engines
Purpose: Traditionally, there have many metrics for evaluating the search engine, nevertheless various researchers’ proposed new metrics in recent years. Aware of this new metrics is essential to conduct research on evaluation of the search engine field. So, the purpose of this study was to provide an analysis of important and new metrics for evaluating the search engines. Methodology: This is ...
متن کاملNEW CRITERIA FOR RULE SELECTION IN FUZZY LEARNING CLASSIFIER SYSTEMS
Designing an effective criterion for selecting the best rule is a major problem in theprocess of implementing Fuzzy Learning Classifier (FLC) systems. Conventionally confidenceand support or combined measures of these are used as criteria for fuzzy rule evaluation. In thispaper new entities namely precision and recall from the field of Information Retrieval (IR)systems is adapted as alternative...
متن کاملA Multilingual Semantic Search Assistant to Facilitate Information Retrieval
This paper describes a multilingual semantic search assistant (MSSA) that could help users find proper keywords in FAO fulltext-based search engines. The MSSA implements four independent functions each associated with the AGROVOC multilingual thesaurus to assist users in choosing better keywords: a Venn diagram-based Boolean search interface, an animated AGROVOC concept browser, cross-language ...
متن کامل